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Abstract 

We study the effect of topology variation on the dynamic behavior of a system 
with local update rules. We implement one-dimensional binary cellular automata on 
graphs with various topologies by formulating two sets of degree-dependent rules, 
each containing a single parameter. We observe that changes in graph topology in- 
duce transitions between different dynamic domains (Wolfram classes) without a 
formal change in the update rule. Along with topological variations, we study the 
pattern formation capacities of regular, random, small-world and scale-free graphs. 
Pattern formation capacity is quantified in terms of two entropy measures, which for 
standard cellular automata allow a qualitative distinction between the four Wolfram 
classes. A mean-field model explains the dynamic behavior of random graphs. Im- 
plications for our understanding of information transport through complex, network- 
based systems are discussed. 

1 Introduction 

Cellular automata (CAs) have been studied in terms of complexity theory and computa- 
tional universality and, moreover, they often serve as models of pattern formation. The 
usual topologies of CAs are chains and regular lattices. Current research on applica- 
tions of graph theory to the analysis of natural and technical systems reveals that many 
real systems are based on networks with a much more complex structure Giaaaa. 
Small-world graphs and scale-free topologies are the epitome of the huge progress in 
attempt^to^assess observed structures and properly model evolutionarily expanding net- 

We, therefore, re-investigate a standard model system of spatiotemporal pattern forma- 
tion, namely binary CAs, by implementing it on a graph and systematically varying topo- 
logical features. How is the spatiotemporal pattern of a CA (for example the capacity 
to display oscillations or the complexity of an element's time evolution within the sys- 
tem) changed, when, e.g., some shortcuts are introduced into the system, or, the regular 
neighborhood structure is completely substituted by a random graph topology? While it 
is clear that the change of a specific CA rule alters the dynamics and, consequently, the 
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spatiotemporal pattern, it seems worthwhile to study the changes under topology variation 
at a fixed update scheme. Some approaches already deal with binary dynamics on com- 
plex topologies. The Ising model for example has been implemented on a small-world 
graph BSD and the scale-free topology has served as the backbone for boolean dynamics 
[10], as well as for the SIS and SIR epidemic models llllLll2ll . Only few attempts inves- 
tigate the connection between changes in topology and the corresponding impact on CA 



dynamics. In II 1 3H the "game of life" is studied on a small- world network and a phase 
transition at a critical network disorder is found. However, the link between dynamic fea- 
tures and topology variation, especially for one-dimensional CAs, has not been addressed 
yet. Therefore, in this paper we pursue the question, to what extent topology determines 
and constrains the capacity of a system to display certain forms of dynamics. 

In the following, we briefly review the cellular automaton (CA) formalism and introduce 
the notation used throughout the paper. 

A CA describes the deterministic time evolution of regularly coupled cells. Formally, a 
one-dimensional (ID) CA consists of a chain of iV cells in states x E E, with the set of 
all possible cell states E, and a transition function A. The standard topology of a ID CA 
is a ring lattice where node i is connected to its k next neighbors ranging from i — k/2 to 
i + k/2 with even k. The transition function A maps the configuration y i of cell state i 
together with its k neighboring cell states at time t, onto the state of the central cell i in 
the next time step, A : y^t) = {xi_ k/2 (t), ...,xt(t),.. .,x i+k / 2 (t)} -> Xi(t + 1). For 
s = \E\ different cell states there exist £ = s k+1 different neighborhood configurations. 
Each transition function A maps these configurations on elements in E, resulting in 
possible transition functions. This combinatorial aspect of the set of possible transition 
functions is also often used to attribute rule numbers to the update rules. To this end, 
the neighborhood configurations y are ordered according to the increasing value of the 
corresponding binary number. In that way sorted, the list of mapped states represents the 
rule number in binary digits. In a system-wide picture, A defines the transitions between 
the s N different system configurations x = {xi, x%, . . . , x n }. From this point of view, the 
configuration space together with the update rule A forms a directed network, where the 
transitions between the system's configurations are completely determined. After at most 
s N time steps, any finite-size CA consisting of iV elements revisits a previously encoun- 
tered state and repeats its dynamics. This network- like aspect of CAs in configuration 
space is frequently discussed in studies of boolean dynamics. 

We will restrict our investigation throughout this paper to a binary state space E = {0, 1}, 
and update all cells synchronously at every time step. The minimal dimension s = 2 of the 
state space keeps the discussion of dynamic properties simple and, furthermore, allows 



for parallels to previous dynamic models and work on elementary CAs II 1411 . 
Different attempts to classify the rule space of CAs have been carried out. Wolfram H15I1 
divided CAs qualitatively into four classes, according to the emerging spatiotemporal 
patterns and analogous to dynamical systems descriptions: I (homogeneous stationary 
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state), II (heterogeneous stationary state or simple periodic structures), III (chaotic be- 
havior), and IV (long range correlations and propagating structures). The introduction of 
the Langton parameter A IU6I1 allowed a quantitative investigation of CA rules, even for 
large rule spaces. While for s > 2 Langton's scheme of generating a transition function 
for a given value of A requires some statistical subsidiary conditions, for binary CAs A 
is simply the number of neighborhoods mapped onto the state 1 divided by the number 
of all possible neighborhood states. For rules generated with the "random-table method", 
where A is used as the probability for a neighborhood to be mapped on state 1 , the Lang- 
ton parameter defines trajectories through the CA rule space and, consequently, through 
the four different dynamical regimes. The order, in which the corresponding Wolfram 
classes are passed as A is increased, is I — ► II — > IV — ► III. Class IV automata, lying be- 
tween periodic (II) and chaotic (III) behavior and exhibiting long-range correlations and 
propagating structures, are regarded as suitable scenarios for the study of complexity and 
self-organization. A recent, alternative parametric approach is given in [17]. There, the 
authors introduce a parameter F controlling details of the transition function beyond the A 
parameter and show the existence of all Wolfram classes for a given A and an appropriate 
F. Obviously, the diversity of classes in a subset of rules with a given A depends on the 
way the rules are generated. 

Our paper is structured as follows: In Section 2, we formulate two classes of binary 
cellular automata on graphs and discuss the resulting dynamics. While the first class 
keeps the Langton parameter A constant, A varies with the parameter k for the second 
class. In the Section 3, we focus on complex spatiotemporal patterns as an indicator 
of optimal information transport and introduce statistical tools for segregating different 
dynamic domains. Applied to ordinary CAs, the Shannon entropy S and the word entropy 
W allow an adequate qualitative separation of the four Wolfram classes. Similarly to 
Langton's investigation, the pattern formation capacity of cellular automata can thus be 
quantitatively analyzed in a two-dimensional plane spanned by the two entropy measures. 
In Section 4 we continuously change topological parameters of the conventional ring 
lattice and implement the two sets of binary dynamics. A link between CAs on graphs, 
as described in this investigation, and more traditional forms of CA studies is provided 
by analyzing regular graph topologies with different neighborhood sizes. We then study 
procedures of topology variations and compare the emerging patterns of small-world and 
random graphs with the well-classified ones from CAs in terms of entropy measures. 
Finally, we study the pattern formation capacity of scale-free graphs and randomized 
variants with the same degree distribution. Section 5 gives a mean-field analysis of the 
dynamic behavior of random graphs based on the local state densities which govern the 
nodes' dynamics. In this way we gain insight into the mechanisms of the considered 
dynamics and the link between some topological and dynamical features. The last section 
(Section 6) reviews the results, discusses implications for the dynamics on real networks 
and lines out some ideas for further investigations. 



3 



2 Cellular automata on graphs 



The topology of a ID CA is usually a regular ring lattice with a clustered neighborhood 
structure, i.e. a graph of N nodes forming a closed chain with additional edges linking 
each element to a certain number of neighbors. In such a graph each node has the same 
degree k due to the links to the kj 2 neighbors in both directions along the chain. In this 
paper we will refer to this specific ring lattice topology as a regular graph. Note, however, 
that in graph theory this term is used for all networks with a delta-like degree distribution. 
Since in CAs the transition function A is defined for a fixed number of neighbors k, this 
system does not provide an appropriate framework for studying changes in the system's 
architecture. A change of k would correspond to an alteration of the underlying rule 
space, which restricts comparability of two systems with different degree. We therefore 
introduce two sets of functions Q^k) and Q 2 (^), each depending on a single parameter 
k, which account for the individually varying architecture and, consequently, allow the 
formulation of binary CAs on arbitrary graphs. 

Let the graph be represented by its adjacency matrix Ay. When a link exists between 
nodes % and j of the graph, the corresponding matrix element is 1, and it is otherwise. 
We consider only undirected graphs. Consequently, the adjacency matrix is symmetric, 
Ay = Aji. We call the first set of rules Vt\. There, the state X{ of node i of a graph flips its 
state in the next time step if the density of l's among the k { elements linked to node i, p^ 
is larger than a parameter k, 



We will refer to this quantity as the local density. Since the sum does not include x { itself, 
the action on node i is invariant under the changing of the central element. This symmetry 
is broken by introducing 




(1) 



There, p { is defined by 




(2) 
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(3) 



where now the density pi incorporates the state xi itself: 




(4) 
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In Q 1 the state Xi(t + 1) depends on the sum over the neighboring states and on the state 
x,i(t) itself, 



whereas in Q 2 the state Xi(t) is also included in the sum. Notably, all rules defined by fli 
are legal, according to Wolfram's definition 11-411 - i.e. they fulfill the quiescent condition 
(a configuration of only zeroes is unchanged) and reflection symmetry (001 and 100 are 
mapped onto the same state). 

In order to get familiar with the set of functions Cli and Vt 2 , it is instructive to apply the 
rules to regular graphs first. In this case, each f^(/«) is identical to a corresponding CA 
rule A. Table[l]shows the neighborhood mappings for an elementary CA, i.e., a CA with 
s = 2 and k = 2. By inspecting the rule table, we can easily infer the corresponding 
C A rules: f2i(0 < k < |) = rule OOIIOIIO2 = rule 54 etc. Earlier investigations on 
elementary CA [14] showed that these rules correspond to stationary (rules 36, 76, 108 
and 204), oscillatory (rule 50) and complex (rule 54) behavior, which can also be inferred 
in a natural way from the definitions ([TJ and ©: According to (UJ), for small k most 
nodes will change their state and an oscillatory behavior will dominate, while for large k 
the majority of nodes will not change their state and a stationary pattern will prevail. In 
between these limiting regimes we expect complex and chaotic behavior. 



As can be inferred from Tab.d the Langton parameter of all Vt\ rules is constant, A = 0.5, 
since the number of neighborhoods mapped on and 1 is equal. This is a generic property 
of VLi. Let y i = {xi_k/2, ■ ■ ■ , denote the neighborhood configuration of node 

% excluding the state X{ itself. Then, under a neighborhood configuration y will 

flip a central as well as a central 1 for an appropriate value of k. Since the identical 
mapping (rule 204) is characterized by A = 0.5 and the number of flipping 0's and l's is 
equal, A = 0.5 for all rules. Therefore, this set of rules exploits a pattern formation 
capacity orthogonal to Langton's investigation and, as we will see, proves the existence 
of all dynamic domains for A = 0.5. This is an elementary example of changing the 
Wolfram class at constant A as stressed in 11711 . 

The lack of the invariance with respect to the central element in fi 2 is responsible for a 
varying Langton parameter in this case. We find that the number of l's in the rule table 
(and accordingly A) varies with k, as shown in Tab.[T] In the regime where oscillatory and 
stationary behaviors coexist and complex behavior can be expected (i.e. | < k < |) most 
neighborhoods are mapped on and the system is prone to a density loss in the course of 
time. 




(5) 



[Table 1 about here.] 
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3 Quantitative classification of spatiotemporal patterns 



In this section we present two entropy measures and apply them to conventional CAs in 
order to separate and categorize general spatiotemporal patterns of such CAs. By select- 
ing only quantities evaluating the time development of single elements (as opposed to 
whole spatiotemporal configurations) this classification scheme can, after gauging it with 
conventional CAs, be directly applied to CAs on graphs, where the degree k is given by a 
distribution P(k). 

The Shannon entropy S relies on the probability for the emergence of the cell states x E E 
in the time evolution of cell i, 

s-1 

Si = - ^2p(xj) \og 2 p(xj) . (6) 

3=0 

For binary dynamics, the p(xj) are the probabilities for O's and l's. Averaging Si over 
all iV cells yields the average Shannon entropy S = J2f=i Si/N. All stationary patterns 
result in S — 0, while random and oscillatory patterns yield S = 1 because of the equal 
distribution of O's and l's in the time series of each cell. 

The word entropy W uses the occurrence of blocks of constant cells of length / (/-words) 
in the time series of cell i, 

t 

Wi = -J>(0log 2 p(0 , (7) 

i=i 

where p(l) is the probability for an /-word, irrespective of the state x this word consists 
of. The maximal word length is clearly the length of the time series T. The average value 
of the word entropy is given by W = J2i=i Wi/N. The word entropy is similar to Wol- 



fram's "measure entropy" I15H . but instead of spatial blocks we use temporal correlations 
here. Moreover, W measures solely the occurrence of blocks of constant cells and not all 
possible blocks of length /. 

Both entropy measures analyze the temporal behavior of cells. The drawback of this 
definition is clearly the dependence of W on the length T of the time series of the pat- 
tern. However, this problem exists for the spatial variant (i.e. the measure entropy), when 
finite-size CAs are considered. As pointed out above, the advantage of the measures pre- 
sented here is their generic applicability to arbitrary topologies, where the analyzed spa- 
tiotemporal patterns lose the spatial information because of the irregular neighborhood 
configurations. 

Alternatives for the word entropy are given by, e.g., the mutual information and by spec- 
tral properties of average-density fluctuations. The Shannon entropy on the other hand 
exhibits partially similar properties as the Hamming distance. We checked that all these 
quantities lead to analog qualitative results. 
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With these tools available we can visualize the separation of CAs within a WS plane. 
Rather than inferring rule space properties, we want to locate domains of spatiotemporal 
patterns on this plane. We therefore gauge the plane with k = 10 CAs, where the initial 
cell states and 1 have been randomly assigned. We generate the different CA rules 
according to Langton's "random-table method", but other parameterizations like the one 
proposed in [ 17] could be used as well. Fig.[T]shows typical patterns of iV = 500, k = 10 
CAs. We can now classify the patterns according to their W and S values within the WS 
plane. Stationary patterns lie in the lower left corner of the plane, while purely oscillatory 
ones are located in the lower right. Chaotic patterns are localized in a rather small region 
in the upper right part of the plane. Between these extremal regions, the plane is filled with 
CAs with partly non-trivial periodic structures and patterns with long-range correlations. 

[Figure 1 about here.] 

We can now plot the CIi(k) and fi 2 ( K ) rules in the WS plane to visually infer the effect 
of increasing k. All the following simulations have been carried out on graphs with 500 
nodes and random initial condition, i.e., every cell is independently assigned a value X{ G 
{0, 1} at time t — 0, resulting in an initial density p(t = 0) of about 0.5. We always drop 
the first 500 time steps and use the second 500 steps to calculate the entropy measures. 
We display the medians of five runs in all following figures to ensure statistical reliability. 
In Fig. El we show the gauged plane with the four Wolfram classes qualitatively assigned 
to specific regions. This allows the immediate identification of the different dynamic 
domains as k is increased for Cli (k) on a regular graph with 2 neighbors or, in the language 
of CAs, the succession of rules 54, 108, 204 for k = 2 CAs. Three snapshots show the 
corresponding patterns, where we selected 100 nodes and 100 time steps for visual clarity. 

[Figure 2 about here.] 

A larger number of rules with Langton parameter A = 0.5 can be studied for a larger 
neighborhood size. Fig. |3] shows the trajectory of k = 10 CAs for increasing k in the 
gauged WS plane. In this case, the transition from oscillatory to stationary behavior is 
accompanied by complex structures in the region of class IV automata. Large W values 
emerge for every k G [0.3, 0.4[, where the exact parameter value is irrelevant because of 
the discrete number of different local densities. 

[Figure 3 about here.] 

Fig. |4] shows ^(k) for k = 2 CAs. In the region | < k < |, where one would expect 
complex patterns analogous to f2 l5 only two neighborhood configurations are mapped 
onto the state 1 (see Tab.[T]), resulting in a density loss and a stationary pattern where 0's 
prevail (Fig.|4j5). 

[Figure 4 about here.] 
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4 Topology variation 



For Qi the variation of k for regular graphs explores the rule space orthogonal to the 
Langton parameter. Different neighborhood sizes result in different trajectories within 
the WS plane. We find the Wolfram classes II,IV and I as n is increased. This transition 
from oscillatory to stationary behavior is a generic property of the sets 
However, in this chapter we want to focus on another feature of the two rule sets, namely 
their applicability to arbitrary topologies. Regardless of the global network structure, 
single nodes evolve according to their local density in every time step. We can monitor 
the dynamical changes of a network along the topological variations. To do so, we first 
have to select an adequate k value where the capacity of producing complex patterns is 
high, as we expect that in this configuration the patterns are most sensitive to the topology 
of the underlying graph. Fig. |5] shows the word entropy vs. k for k = 6 and k = 10 
regular graphs and, since we will deal with random graphs later on, for a random graph 
of the Erdos and Renyi type 111 8ll with a mean degree of 10. 

[Figure 5 about here.] 

In order to encounter a large variety of patterns and high word entropies for both regular 
and random graphs, we choose a k value within the interval [0.35, 0.4[. In the following 
simulations, k = 0.36 will be used as the parameter value for the fij, but similar values of 
k would serve as well, as can be inferred from Fig. 

As a first step we continue analyzing regular graphs — and thereby allow for conven- 
tional CA interpretation — but increase the neighborhood size k for every node in even 
numbers. In this case, Qj(0.36) corresponds to a different CA transition rule A for each 
neighborhood size k. Fig.[6]shows W and S of spatiotemporal patterns of Oi and fi 2 (top) 
on regular graphs against increasing neighborhood size k. The small difference in the def- 
inition of the two sets of rules leads to striking differences of the dynamic response for 
regular graphs. For small k we find a multiple peak structure in the entropy measures for 
fii and a variety of different spatiotemporal patterns. For f2 2 , the word entropy W is close 
to for all neighborhood sizes. For large neighborhoods around k > 30, the dynamics 
is purely oscillatory, indicated by S = 1 and W = 0. The lower picture in Fig. |5] shows 
the path for f2 x in the WS plane as k is increased. The peak structure in the picture above 
appears now as jumps between different Wolfram classes. 

[Figure 6 about here.] 

The entropy values for large k can be understood in the limiting case of a completely 
connected graph (complete graph) which corresponds to CAs with k = N — 1. There, 
the neighborhood is approximately identical for all nodes and the overall dynamics is 
governed by the initial density p(t = 0). For p(0) < k all nodes remain in their initial 
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state, for p(0) Al— p(0) > k the nodes oscillate constantly, while for 1 — p(0) < k < p(0), 
all nodes flip their state in the first time step and then remain constant. Above a certain 
critical value of the connectivity, all elements have essentially the same neighborhood 
and consequently display the same dynamical behavior. This threshold is independent of 
other topological details and corresponds to the synchronization threshold known from 
(continuous) dynamical systems. 

If we decrease k, the densities of l's in the neighborhoods y i = {x_k/2, ■ ■ • ,2^/2} in- 
creasingly differ and at some point, these differences lead to a coexistence of stationary 
and oscillatory behavior, i.e., complex system dynamics can emerge. If we regard fi 2 , 
we find that the coexistence of stationary and oscillatory behavior is not sufficient for the 
emergence of complex system dynamics. There, the transition between the stationary and 
oscillatory domains is accompanied by spatially clearly separated blocks of different be- 
havior, as can be seen in the pattern examples in Fig. [6] 

A second way to study the influence of topology is to gradually rewire the original regular 
graph. We can conduct this procedure with the preservation of the degree distribution 
P(k) (randomization) or without preserving P(k) (rewiring), resulting in two different 
topologies. If the degree distribution P(k') = 5k t k> is conserved, we end up with a regular 
graph where the k couplings of every node are randomly chosen out of the N— 1 remaining 
nodes. We will refer to this type of graph as the DDR (delta-distributed random) graph. 
Note that DDR graphs can also be considered as undirected Kauffman networks [19]. 
In the other case, where the degree distribution is altered in the course of the rewiring, 
we end up with a binomial degree distribution and a mean degree k. This limiting case 
coincides with the ER graph discussed above. Such a rewiring procedure has first been 
introduced by Watts and Strogatz [6] as a model of small-world graphs. Fig. |7] visualizes 
the two methods for a regular ring lattice with N = 15, k = 4. 

[Figure 7 about here.] 

In both cases, the strict analogy to a CA and a concrete rule numbering is lost as soon as 
the architecture differs from a regular nearest-neighbor configuration and the applicability 
of the Qi to arbitrary topologies is exploited. In Fig.[8]we display the emerging spatiotem- 
poral patterns as the rewiring and randomization depth p is increased. This quantity is the 
ratio of rewired links to all existing links. While for CIi(k = 0.36), both procedures result 
in similar patterns, fi 2 resolves the different degree distributions: the two architectures 
(ER and DDR ) lead to stationary and non-trivial patterns respectively. However, we have 
to note that the linear arrangement of nodes according to the node number in the space- 
time plots has no topological foundation. Adjacent nodes in the pattern do no longer have 
to be linked to each other as the underlying graph is rewired. 

[Figure 8 about here.] 
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Fig. HI visualizes the trajectories of the two procedures for and f2 2 in the gauged WS 
plane and locates the corresponding pattern formation capacity. The decrease of the word 
entropy for Qi relies on the continuous disintegration of clustered neighborhoods. For f2 2 
we find the opposite behavior: The clustering inhibits complex patterns for this parameter 
setting and only the randomization of links allows for non-trivial structures. The large 
coverage of dynamic domains demonstrates the large and systematic regulation of pattern 
formation capacity by topology. 

[Figure 9 about here.] 

We can close the link between the two topological variations by increasing stepwise the 
degree k in the generated networks, ending up with complete graphs, as discussed in the 
beginning of this section. In Fig.[lO]we show the procedures for small ring lattices for 
ER and DDR graphs respectively. 

[Figure 10 about here.] 

Fig. HU shows the effect of increasing k on the word entropy W of patterns of ER and 
DDR graphs for both f2j. The increase of the neighborhood size results in the leveling of 
individual neighborhood density differences. For k > 60 all nodes see approximately the 
same density of 1 's within the linked elements and follow a collective behavior (oscillation 
for this k). In contrary to the regular graphs, ER and DDR graphs are both capable of 
generating complex patterns for Q 2 . 

[Figure 1 1 about here.] 

The class of graphs, which received particular scientific attention in the last few years, are 
scale-free graphs [7] whose power-law degree distribution is ubiquitous in nature. There- 
fore, it is interesting to assess, how topological variations affect the dynamic behavior and 
moreover, if these graphs show some kind of extremal pattern formation capacity. 
We use the Barabasi-Albert (BA) algorithm [7] to generate graphs and then apply three 
algorithms, which change the topology but keep the degree distribution P(k) constant 
as described in [20]. We randomize, hierarchize and antihierarchize the networks by 
rewiring pairs of edges according to the corresponding reconnection rule. Randomization 
rewires two pairs of linked nodes randomly. The hierarchization process connects nodes 
with similar degree and thus imposes an ordering of degrees within the network. This 
results in chains of linked cells with increasing degree and interconnected hubs, i.e., the 
nodes with extremely high degree are linked together. Antihierarchization, though, links 
nodes with high and low degree and levels hierarchical structures in the network. The 
degree correlations of graphs generated with the latter two procedures resemble the assor- 



tative and disassortative mixing observed in real networks 112 ID . Fig. [12] shows the effect 
of randomizing a BA scale-free graph with minimal degree k = 4 up to a randomization 
depth of p = 2.5 within a section of the WS plane for f2i(0.36). Each process affects the 
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response of the system. While randomization increases and antihierarchization decreases 
W slightly at nearly constant S, the hierarchization process yields maximal W values for 
a randomization depth of p ~ 2 and a relatively large variation of 5". 
The extremely inhomogeneous degree distribution of this kind of graphs results in an in- 
homogeneous word entropy distribution, contrary to regular graphs, where the nodes are 
indistinguishable with respect to their degree, and the distribution is delta-like. The inset 
in Fig. [T2l shows Wi against the degree ki for all nodes of a BA scale-free graph. Obvi- 
ously, the hubs in the system account for small W , while nodes with a minimal degree are 
responsible for large and maximal W. Concerning the pattern formation capacity of hi- 
erarchize scale-free graphs, the maximal Wi generated by single nodes increases with the 
degree of hierarchization up to a saturation level. This level around W = 4 for 2000 hier- 
archization steps lies clearly above the maximal values observed for conventional CAs. 

[Figure 12 about here.] 



5 Density distribution analysis 

In the previous section we found that a large number of neighbors synchronizes the system 
and thus inhibits complex behavior. In this section, we want to put the argument on a 
more quantitative level, infer the domain of dynamic behavior from the distribution of the 
individual densities P(pi) and give an explanation for the characteristic structure of the 
word entropy as k is increased for random graphs (Fig. [HI). 

The local densities pi(t) and pi(t) defined in Eqs. (|2l) and © control the evolution of 
node i at time t for both rule sets. The dynamics therefore depend on the parameter k 
and on the topology of the underlying graph, which defines the numbers and positions of 
the linked elements. Let us consider the case of an initial state density p(0) = 0.5. The 
topology then determines the density distribution P(pi). In all the following discussions, 
we assume that P(pi) is time independent and neglect deformations of P(pi) in the course 
of time. In this case, essential features of the dynamics can be immediately derived. 

[Figure 13 about here.] 

In the discussion of Fig. we argued that for large k all nodes react according to the same 
density p^ ps p(0) and are therefore synchronized. For smaller k values, the differences 
in the individual densities pi account for the coexistence of dynamic behaviors. We can 
visualize this difference by plotting the distribution of individual densities, P(pi), for a 
small and a large neighborhood, together with the parameter k in Fig. [T3J Cells with 
densities left of the k line are stationary, while cells to the right change their state. For a 
large neighborhood with k = 50, nearly all nodes oscillate according to their large local 
densities pi > k. However, for k = 10, we find a considerable fraction of cells stationary 
and argue that this coexistence of dynamic domains allows for complex behavior. Note 
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that the distributions in Fig. [13] are not normalized but scaled to the identical maximum 
value. This is done because only the ratio of oscillatory and stationary cells at fixed k 
provides the relevant information on the dynamics. 

The peak structure of the word entropy for graphs with increasing neighborhood size k in 
Figs. [6] and [TT] is evident for both regular and DDR graphs. We can explain this structure 
for DDR graphs with the following mean-field approach for f^. Let y i be the configura- 
tion of the coupled states of node i, y i = . . . , Node % remains constant, if its 
local density pi is smaller than k. Thus, the fraction r of constant cells is the sum over all 
neighborhood configuration with p < k, 

r = J>KP(0)) = £ Q)p(0) m (l -p(0)) fe " m , (8) 

m=0 m=0 ' 

where \_(z) is the greatest integer less or equal z, m the number of 1 's within y i and p(m) 
is the probability for finding m out of k neighbors in state 1 for the initial density p(0) 
and Vti. In Fig. [14a we plot this number r against the neighborhood size with parameters 
k = 0.36 and an initial density of p(0) = 0.5 and compare it to the W values observed in 
a numerical simulation. The simulated curve is identical to the one in Fig. [TT|, apart 
from the now enlarged degree range from 2 to 80. 

[Figure 14 about here.] 

The direct proportionality between r and W over a wide range of k supports the approach 
to link the initial settings with the corresponding dynamic domain. However, a discrep- 
ancy for k = 4 and k = 6 is obvious, since the word entropy values are for this degrees. 
We argue, that r values above 0.3 inhibit complex behavior in this DDR graph because of 
too many stationary elements. This threshold has to be inferred from the comparison of 
the simulated W and the calculated r values. Nevertheless, together with this threshold, 
we can predict the complexity of the time evolution simply from the topology and the ini- 
tial local densities for random graphs. This fails for regular graphs, as can be seen from 
Fig-El where the shape of W differs clearly from the one in Fig.[l4[ For those graphs, the 
density distribution P(pi) is well responsible for the peak structure and identical at t = 
but the spatial correlations emerging in this topology because of the clustered neighbor- 
hoods alter this distribution in the course of time. 

We can generalize the mean-field approach to other topologies by incorporating the degree 
distribution P(k) in Eq.0 

N-l link') 

r(k, k, p(0)) = £ P(k) PK P(0)) (9) 

k=0 m=0 

In this way we can explain the smoothing of the peak structure for ER graphs as k is 
increased in Fig.[TT] Moreover, Eq. © can be applied to infer the dynamic behavior of 
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scale-free graphs. Instead of varying the degree k, we now study the dynamic behavior as 
k is increased from to 0.5. Fig. [14b shows W(k) from a simulation and the calculated 
r for a BA scale-free graphs with minimum degree k = 5. Again, the qualitative trend 
and the jumps in the word complexity are well predicted by r. For r > 0.3 the complex 
behavior collapses and W drops sharply to 0. Thus, BA scale-free graphs can be described 
properly by the mean-field approach for random graphs, i.e. their local density distribution 
remains approximately constant. Notably, with a slight alteration of p(m, p(0)), the set of 
rules Q 2 can be also described by Eq. ©. 

6 Conclusions 

The role of topology for dynamics is becoming one of the key topics of nonlinear dynam- 
ics and the theory of self-organization. In this paper we show by numerical simulation 
that the pattern formation capacity of binary CAs strongly depends on the topology of 
the underlying graph. We used two temporal entropies, the Shannon entropy S and the 
word entropy W, to separate the different dynamic domains. We formulated two classes 
of binary cellular automata on graphs, fix and fi 2 , each depending on a single param- 
eter k. While the first class keeps the Langton parameter A constant, A varies with k 
for the second class. If applied to regular graphs, the two sets fij naturally parameterize 
and categorize a subset of CA rules. Thus, we studied the transition between stationary 
and oscillatory behavior for these two CA rule sets. We assessed the influence of the 
neighborhood size k for the pattern formation capacity of CAs for a rule that accounts for 
increasing k. For large k, we observed synchronization of the elements and the absence 
of complex patterns. Beyond the conventional CA topology, we investigated the effect of 
topological variations. We found a crucial dependence on the central element by compar- 
ing the two rule sets. We found that a continuous change in the topological parameters 
of a graph can lead to a continuous trajectory in the WS plane. Moreover, we studied 
the pattern formation capacity of modified BA scale-free graphs. Hierarchizing such a 
network leads to a increase in the word entropy for low-degree nodes. 
The following observations on the link between topology and dynamics have been made: 

• The inclusion of the state of cell i itself into the local density has a fundamental 
impact on the emerging dynamics. For all graph types we found distinct differences 
between the two sets fix(/«) and ^(k) for a large range of the parameter k. 

• Graphs with a delta-like degree distribution display a characteristic peak structure in 
the word entropy as the neighborhood size is increased from small values (cf. Fig.|6] 
and Fig. [TT] for regular and DDR graphs respectively). This crucial dependence on 
the number of neighbors allows for multiple transitions between different dynamic 
domains as k grows. This is due to the discrete distribution of local densities and 
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can be understood with a mean-field approach. However, the local correlations in 
the CA topology account for the enormous jumps in this case. 

• Rewiring a regular topology disintegrates the clustered neighborhoods and destroys 
gradually local collective behavior. Beyond the small-world regime, the ability 
to produce long-range correlations is lost. If differences of the rewiring process 
(conservation or alteration of the degree distribution) can be resolved or not depends 
decisively on the definition of the dynamics applied (cf. Fig.©. 

• In scale-free graphs a variation of the degree correlations changes the word entropy 
of the time series of individual nodes. The maximal Wi values occur for nodes in 
the low-degree domains of hierarchized topologies and lie far above their regular 
counterparts. However, there are also nodes with small Wi for all degrees, resulting 
in an average W within the range of values from conventional CAs. 

Aside from trajectories of topological variations, the path of a graph along the variation of 
k may be used for the topological characterization. In principle, the trajectory in the WS 
plane as a function of k (e.g., for could serve as a dynamical signature of a particular 
graph, which assesses the graph's capacity to display complex dynamics. We found that 
the two rule sets are sensitive to variations in different network types. A detailed study 
of the connection between the dynamic response and such graph differences, even up to 
the motif level, along k, may be an adequate prerequisite for the characterization of real 
biological and technical graphs with the means of the rule sets proposed in this paper. 
Eventually, it would be interesting to implement our CA rules, e.g., on protein interaction 
graphs and compare this dynamical signature with those from the graph's randomized 
counterparts in search for an evolutionary optimization on this level. 
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Figure 1 : Typical patterns of the different dynamic domains within the WS plane. The 
plane is filled with N = 500, k — 10 CAs where the time interval ]500, 1000] has been 
used to calculate W and S. Patterns of stationary, oscillatory, periodic and chaotic au- 
tomata, (a) - (f), comprise 500 time steps, the two class IV patterns (f) and (g) comprise 
2000 time steps. 0's are indicated black, l's white. 



18 



0.2 0.4 0.6 0.8 1 

Shannnon entropy S 



Figure 2: Behavior of Vti for elementary, i.e. k = s = 2, CAs within the WS plane as k 
is increased. The three possible neighborhood configurations correspond to the rules 54, 
108, 204 (see Tab. [l]). For computation of W and S here and in the following the same 
system size as in Fig. [I] has been used (N = 500, T = 1000) with a transient of 500 
time steps being dropped. The patterns represent the three possible domains and show a 
selection of 100 nodes for 100 time steps for visual clarity. Note that there are no precise 
borders between the different regions in the WS plane. Therefore the highlighted regions 
reflect a tendency rather than a strict distinction between two adjacent Wolfram classes. 
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Figure 3: Behavior of for k = 10 CAs within the WS plane as k is increased. Only for 
k E [0.3, 0.4[ (b) complex patterns emerge, for all other parameters, the corresponding 
rules result in purely oscillatory and stationary patterns respectively. The other spatiotem- 
poral patterns shown in the top row correspond to parameter values k E [0.2, 0.3 [ (a), 
k e [0.4, 0.5 [ (c) and k G [0.5, 0.6 [ (d), again for 100 nodes and 100 time steps. 
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Figure 4: Behavior of f2 2 for elementary CAs within the WS plane as k is increased. 
The corresponding rule numbers for the elementary CA are 50, 36, 76, 204 (see Tab.[l]). 
Again, the patterns show 100 nodes for 100 time steps. All stationary patterns are mapped 
onto the same point in the WS plane. 
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Figure 5: The word entropy W against the variation of k for Vti for two regular graphs and 
an ER random graph. Complex patterns prevail in the interval between 0.3 < k < 0.4 
for the two graph types. 
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Figure 6: Word entropy (solid) and Shannon entropy (dashed) as a function of neighbor- 
hood size k for f2i and Q 2 (top). The inset patterns show the evolution of 100 nodes for 
100 time steps for three different values of k. The lower picture shows the trajectory of 
regular graphs in the WSplane under as k is increased. 
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Figure 7: Rewiring (top) and randomization (bottom) of a regular graph. In the first case, 
the resulting degree distribution P(k) is binomial and nodes with k = 2 occur, while 
in the second case, the original degree distribution P(k) = 5 fe 4 is conserved during the 
process. 
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Figure 8: Spatiotemporal patterns for the different rewiring mechanisms described above 
for increasing rewiring and randomization depth p. The resulting patterns differ consider- 
ably for fii and f2 2 . 
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Figure 9: The four trajectories for Qi and f2 2 for the rewiring and randomization process 
of an originally regular graph with N = 500, k = 10. The two paths for are nearly 
identical while the ones for VL 2 differ enormously. 
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Figure 10: Increase of the degree for ER and DDR graphs. We show graphs with 15 nodes 
for k — 4, 8, 12, 14. We end up with complete graphs for both procedures. 
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Figure 1 1 : Word entropy W for increasing k for DDR (solid) and ER (dotted) graphs and 
both rule sets. DDR graphs show a peak structure with drops to W = for fi 2 (bottom). 
ER graphs show a similar overall behavior albeit without peaks and a smoothed curve. 
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Figure 12: Effects of randomization (dashed), hierarchization (gray) and antihierarchiza- 
tion (gray) of a BA scale-free graph with minimal degree 4 within the WS plane. The 
inset shows the word entropy values of 500 single nodes of the graph against their degree. 
Obviously, high W-i values result from nodes with minimal degree. 
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Figure 13: Scaled density distributions P(pi) for DDR graphs with k — 10 and k = 50. 
The line defined by k indicates the ratio of stationary to oscillatory nodes with local 
densities p { . 
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Figure 14: Fraction of constant cells r compared with the word entropy W for two random 
topologies for f^. The upper picture shows DDR graphs as k is increased. The lower one 
shows a BA scale-free graph with minimal degree k = 5 under variation of the parameter 
k. In both figures a threshold for r around 0.3 is observable, above which complex patterns 
disappear. 
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Table 1: Neighborhood mappings of rules Qi and Q 2 for elementary CAs, i.e. with k = 
s = 2. The number of different rules is k and k + 1 for f2i and f2 2 , respectively. If the 
state of the node changes, the corresponding entry is shown in bold face. In the last row, 
the corresponding CA rule numbers are shown. 
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